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FIELD OF INVENTION 

The present invention relates generally to identifying electronic device 
users and, more particularly, to identifying users by user activity patterns. 

10 BACKGROUND 

Determining an electronic device user's correct identity is useful for 
security and customization purposes. Once a user's identity is known, for 
example, the electronic device (e.g., a personal computer, a personal digital 
assistant) can be customized specifically for the identified user. Frequently 
15 accessed websites can be stored as "favorites" within a web browser, and 

frequently accessed content selections can be presented to the user in a drop 
down menu. 

In addition, a third party (e.g., content provider, user supervisor) can 
control access to certain content and application programs based on the device 
20 user's identity. 

There are a variety of ways to identify an electronic device user, including 
password, personal identification number (PIN), and biometric parameter (e.g., 
fingerprint, iris scan, DNA sample). But users typically find that it is inconvenient 
to remember a password or PIN, and measuring a biometric parameter requires 
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equipment in addition to the electronic device being used. 
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SUMMARY 

Methods and apparatuses for determining the identity of the user detect a 
current user's electronic device activity pattern; compare the detected activity 
5 pattern against a plurality of user action identification profiles, wherein each user 
action identification profile is associated with a particular user; and use the 
comparing to identify the current user as being the particular user. 

In one illustrative embodiment, a module monitors a current user's 
electronic device inputs to determine the current user's idiosyncratic activity 

10 pattern. If the detected activity pattern is deemed sufficiently close to a historic, 
idiosyncratic activity pattern associated with a particular user, then the current 
user is identified as the historic, particular user. Monitored activity patterns 
include one or a combination of the user's selected content, the user's manner of 
selecting the content, and/or the context in which the user makes certain inputs. 

15 In some instances, the module monitors for the type of content a user 

selects for output, and for the order in which the user selects the content. For 
example, one user may select two or more recorded songs for output in a 
particular and historically consistent order. 

In some instances, the module monitors for the ordered manner in which a 

20 user selects a desired output. For example, one user may consistently select a 
particular song by first selecting a music genre category, then by selecting an 
album that contains the song, and then by finally selecting the song. Another 
user, however, may consistently select the particular song by first selecting a 
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music artist category, then by selecting the artist's album that contains the song, 
and then by finally selecting the song. 

In still other instances, the module monitors the physical manner in which 
the user operates the electronic device. For example, two users will each dial a 
5 particular telephone number in a slightly different way. Two users will each make 
keypad inputs at different speeds. There will be small but measurable consistent 
delay patterns between keypad inputs. One user may habitually use two hands 
to operate a cellular telephone keypad (e.g., hold with left hand; dial with right 
index finger). Another user may habitually operate the cellular telephone keypad 
10 with a single hand (e.g., hold with right hand; dial with right thumb). Therefore, 
the module monitors the durations and intervals of a user's keypad input 
patterns. The differences in the physical manner of the inputs help identify the 
current user. 

In yet other instances, the module monitors for a context in which the user 
15 operates the electronic device. Certain users are likely or unlikely to make 
certain inputs. For example, a cellular telephone is accessed by dialing its 
unique telephone number. The cellular telephone, and its telephone number, are 
typically associated with a particular person. If at a central location the module 
monitors the unique telephone number being dialed, then since people rarely 
20 telephone themselves there is a low probability that the user dialing the 

telephone number is the particular person associated with unique telephone 
number. 



4 



PATENT 
SONY-05400 

A user identification system stores one or more historic, idiosyncratic 
activity patterns as user action identification profiles. A comparitor module 
identifies the current user by comparing the current user's detected activity 
pattern against one or more stored user action identification profiles. If the 
5 comparison is sufficiently close, the current user's identification is established. In 
one embodiment, once the current user's identification is established, either 
passively by the comparitor module, or actively by requesting specific user input 
(e.g., a password), the identification system updates the identified user's action 
identification profile. For example, the system updates the user's idiosyncratic 
10 input patterns as the user's taste in often-selected content changes or the user 
becomes more proficient in her manner of making frequently-entered input 
patterns. 

In some embodiments the user identification system is wholly contained 
within the electronic device that the user is operating. Such all-in-one 

15 embodiments operate to, for example, prevent unauthorized use of the device. 
In other embodiments, the user identification system is placed at a central 
position (i.e., a "back-end") that is accessed by one or more user-operated 
electronic devices (i.e., "front-ends"). Such distributed embodiments also 
operate to prevent unauthorized use of associated systems or, for example, 

20 distinguish among several system users. 
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BRIEF DESCRIPTION OF DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a 
part of this specification, illustrate and explain embodiments of methods and 
5 apparatuses for determining an electronic device user's identity. In the 
drawings, 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for determining the identity of the user are implemented. 

Figure 2 is a simplified block diagram illustrating one embodiment in which 
10 the methods and apparatuses for determining the identity of the user are 
implemented. 

Figure 3 is a simplified block diagram illustrating an exemplary 
embodiment of the methods and apparatuses for determining the identity of the 
user. 

15 Figure 4 is a simplified block diagram illustrating an exemplary selection 

option available to the user in which the methods and apparatus for determining 

the identity of the user are implemented. 

Figure 5 is a flow diagram, consistent with embodiments of the methods 

and apparatuses for determining the identity of the user. 
20 Figure 6 is a flow diagram, consistent with embodiments of the methods 

and apparatuses for determining the identity of the user. 
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DETAILED DESCRIPTION 

The following detailed description of the methods and apparatuses for 
determining the user's identity refers to the accompanying drawings. The 
5 detailed description illustrates embodiments of the methods and apparatuses for 
determining the user's identity and is not intended to construct limitations. 
Instead, the scope of the invention is defined by the claims. 

Those skilled in the art will recognize that many other implementations are 
possible and are consistent with the methods and apparatuses for determining 
10 the identity of the user. 

References to "content" includes data such as audio, video, text, graphics, 
and the like, that are embodied in digital or analog electronic form. References 
to "applications" includes user data processing programs for tasks such as word 
processing, audio output or editing, video output or editing, digital still photograph 
15 viewing or editing, and the like, that are embodied in hardware and/or software. 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for determining the identity of the user are implemented. The 
environment includes an electronic device 110 (e.g., a computing platform 
configured to act as a client device, such as a personal computer, a personal 
20 digital assistant, a cellular telephone, a paging device), a user interface 115, a 
network 120 (e.g., a local area network, a home network, the Internet), and a 
server 130 (e.g., a computing platform configured to act as a server). 
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In some embodiments, one or more user interface 1 1 5 components are 
made integral with the electronic device 110 (e.g., keypad and video display 
screen input and output interfaces in the same housing as personal digital 
assistant electronics (e.g., as in a Clie® manufactured by Sony Corporation). In 
5 other embodiments, one or more user interface 115 components (e.g., a 

keyboard, a pointing device (mouse, trackball, etc.), a microphone, a speaker, a 
display, a camera) are physically separate from, and are conventionally coupled 
to, electronic device 110. The user uses interface 1 15 to access and control 
content and applications stored in electronic device 110, server 130, or a remote 

10 storage device (not shown) coupled via network 120. 

In accordance with the invention, embodiments of user identification as 
described below are executed by an electronic processor in electronic device 
1 10, in server 130, or by processors in electronic device 1 10 and in server 130 
acting together. Server 130 is illustrated in Figure 1 as being a single computing 

15 platform, but in other instances is two or more interconnected computing 
platforms that act as a server. 

Figure 2 is a simplified diagram illustrating an exemplary architecture in 
which the methods and apparatus for determining the identity of the user are 
implemented. The exemplary architecture includes a plurality of electronic 

20 devices 110, server device 130, and network 120 connecting electronic devices 
1 10 to server 130 and each electronic device 1 10 to each other. The plurality of 
electronic devices 1 10 are each configured to include a computer-readable 
medium 209, such as random access memory, coupled to an electronic 
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processor 208. Processor 208 executes program instructions stored in the 
computer-readable medium 209. A unique user operates each electronic device 
1 10 via an interface 1 15 as described with reference to Figure 1. 

Server 130 includes a processor 21 1 coupled to a computer-readable 
5 medium 212. In one embodiment, the server 1 30 is coupled to one or more 
additional external or internal devices or applications, such as, without limitation, 
a secondary data storage element, such as database 240. 

In one instance, processors 208 and 21 1 are manufactured by Intel 
Corporation, of Santa Clara, California. In other instances, other 
10 microprocessors are used. 

One or more user applications are stored in media 209, in media 212, or a 
single user application is stored in part in one media 209 and in part in media 
212. In one instance a stored user application, regardless of storage location, is 
made customizable based on determining an identity of a user using 
15 embodiments described below. 

The plurality of client devices 110 and the server 130 include instructions 
for a customized application for determining an identity of a user. In one 
embodiment, the plurality of computer-readable media 209 and 212 contain, in 
part, the customized application. Additionally, the plurality of client devices 110 
20 and the server 130 are configured to receive and transmit electronic messages 
for use with the customized application. Similarly, the network 120 is configured 
to transmit electronic messages for use with the customized application. 
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Figure 3 is a simplified diagram illustrating one embodiment of a user 
identification module 310. In one embodiment, the user identification module 310 
is configured to determine the identity of a particular user who is using electronic 
device 1 10 by examining the user's activity. In one embodiment, the user 
5 identification module 310 is embodied in electronic device 110. In another 

embodiment, identification module 310 is embodied in server 130. In yet another 
embodiment, identification module 310 is embodied, in part, in electronic device 
1 1 0 and, in part, in server 1 30. 

As shown in Figure 3, the user identification module 310 includes a 
10 detection module 320, a comparator module 330, and a database module 340. 
Each of the modules 320, 330, and 340 are configured to communicate with each 
other. 

Detection module 320 is configured to monitor the user's activity on 
electronic device 110. In one embodiment, detection module 320 senses one or 

15 more of the user's inputs and outputs on interface 115 (Figure 1). 

In one instance, for example, the detection module 320 is configured to 
sense activity performed by the user such as selection of various content items 
for output, applications for use, or various content or application categories (e.g., 
"rock music") for further selection via, for instance, a drop down menu. In some 

20 embodiments, the sensed user activity includes both the actual activity performed 
and the order in which particular activities are performed. In another instance, 
detection module 320 is configured to sense one or more times associated with 
the user's activity on electronic device 110. For example, detection module 320 
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determines a time interval between inputs (e.g., between two user menu 
selection inputs). 

In one embodiment, the database module 340 is configured to store an 
action identification profile for a particular user. The action identification profile 
5 for the particular user includes, for example, a record of the activity (e.g., specific 
actions and order of actions) and activity time (e.g., intervals between actions) 
information associated with the particular user. That is, the user action 
identification profile is a record of the particular user's patterns of use for 
electronic device 110. In one instance, for example, the unique user action 

10 identification profile includes a record of web sites, which represents the user's 
unique website viewing habits. In another instance, the unique user action 
identification profile includes a number of content items that are frequently 
accessed by the user. In yet another instance, the unique user action profile 
includes an ordered sequence of actions frequently performed by the user. 

15 In some embodiments, database module 340 stores two or more unique 

user action identification profiles, each profile being associated with a 
corresponding unique user so that each of several users of a single electronic 
device 110 can be identified. 

In some embodiments, the database module 340 receives information 

20 associated with the one or more user's actions and action times via detection 
module 320. 

In some embodiments, one or more stored user action identification 
profiles are refined after first being established so as to more accurately record 
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information associated with a unique user's actions, and thereby making the 
stored action identification profile more accurate. In some instances, the user 
action identification profile refinement continuously occurs after, for example, the 
user's identity is confirmed to ensure that profile refinement is correct. 
5 Comparator module 330 is configured to compare activity being performed 

by an electronic device 1 10 user against at least one user action identification 
profile stored by database module 340. In the embodiment shown in Figure 3, 
for example, comparator module 330 receives information associated with a 
user's detected current actions via detection module 320 and user action profile 

10 information from database module 340. Comparator module 330 then 

determines the quality of a match between the received user current action 
information and the received user historical profile information. If the match 
quality is determined to be sufficient, comparator module 330 outputs data 
indicating that the current electronic device 110 user is identified as the user 

15 associated with the stored user action profile. 

In some embodiments, the comparator module 330 uses a predetermined 
threshold score to determine the match quality between a particular user action 
identification profile and the activity(ies) currently being performed by a user. For 
example, comparator module 330 compares the current user's actions against a 

20 stored user action identification profile and scores the comparison. If the 

comparison score reaches or exceeds the predetermined threshold score, then 
comparator module 330 identifies the current user as being the user associated 
with the stored user action identification profile. 
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The duration of a user's current activity that is compared against a user 
action identification profile may last for a fraction of a second to several minutes 
prior to reaching the predetermined threshold score. 

In another embodiment, the comparator module 330 receives information 
5 associated with a current user's activity for a predetermined length of time and 
identifies a particular user through a best match from the profiles within the 
database module 340. For example, based on the current user's activity 
performed by the user for the predetermined length of time, the comparator 
module 330 compares the user's current activity against stored user action 

10 identification profiles and selects the particular user having a profile that best 
resembles the current user's activity. 

In various embodiments, any combination of predetermined threshold 
score and predetermined length of time are used to identify a particular user 
based on the user's activity. 

15 The user identification module 310, the detection module 320, the 

comparator module 330, and the database module 340 are shown for illustrative 
purposes and are not intended to limit the scope of the methods and apparatuses 
for determining the identity of the user. Any number of these modules may be 
combined without departing from the scope of the methods and apparatus for 

20 determining the identity of the user. Further, additional modules may be added 
without departing from the scope of the methods and apparatus for determining 
the identity of the user. 
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Figure 4 is an exemplary decision tree 400 for illustrating choices that 
shape the user's activity. In one embodiment, the type and manner of the user's 
activity as they navigate within this illustrative tree is utilized in determining the 
user's identity within the user identification module 310. 
5 In one embodiment, the decision tree 400 illustrates choices that are 

navigated by a user when selecting a musical album. In other embodiments, the 
decision tree 400 provides a variety of options for the user, such as selecting 
particular applications and/or content, performing tasks in a specific order, and 
the like. 

10 In one embodiment, the decision tree 400 is configured to allow the user 

to begin at a root 405 and to select among a genre category 410, an artist 
category 415, and an album title category 420. 

In the embodiment illustrated in figure 4, the genre category 410 includes 
a soft rock genre 425, a classical genre 430, and jazz genre 440. If the user 

15 chooses the genre classification 410, the user is presented with further choice of 
the soft rock genre 425, the classical genre 430, and the jazz genre 440. 

In one embodiment, there are multiple albums available to the user under 
each genre selection. For example, albums 445, 450, and 455 represent album 
selections available to the user when the user selects the soft rock genre 425. 

20 Similarly, albums 460 and 465 represent album selections available to the user 
when the user selects the classical genre 430. Albums 470, 475, 480, and 485 
represent album selections available to the user when the user selects the jazz 
genre 425. 



PATENT 
SONY-05400 

In use, selection of an album from the decision tree 400 illustrates a user's 
activity in selecting content. Further, the use of categories as shown within the 
decision tree 400 to select albums provides an exemplary illustration of a user's 
activity in selecting a category. Instead of selecting an album by first selecting 
5 the genre category, for example, a user may begin by first selecting the artist or 
title categories. Content items available for selection may, in some instances, be 
indexed within a single category, or in other instances may be indexed within two 
or more categories. 

The flow diagrams as depicted in Figures 5 and 6 are exemplary 
10 embodiments of the methods and apparatuses for determining the user's identity. 

The blocks within the flow diagrams can be performed in a different 
sequence without departing from the spirit of the methods and apparatus for 
determining the identity of the user. Further, blocks may be deleted, added, or 
combined without departing from the spirit of the methods and apparatuses for 
15 determining the user's identity. 

Figure 5 is a flow diagram that illustrates an embodiment in which the 
user's identity is determined by detecting the user's activity. 

In Block 510, the user's activity is detected by, e.g., the detection module 
320. In some embodiments, the user's activity is the user making selection 
20 choices, such as for content, applications, web sites, categories, and the like. In 
other embodiments, the user's activity is the user making a series of selection 
choices. By making a series of selection choices, the order of the selection 
choices are considered in addition to the selections themselves. For example, a 
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distinction is made between a user's selection of the album 470 prior to selecting 
the album 465 and a user's selection of the album 465 prior to selecting the 
album 470. In yet another embodiment, the user's activity is the timing between 
inputs from the user. For example, the detected activities are varying length of 
5 time between inputs from the user as the user makes specific inputs (e.g., menu 
selections) or user interface 1 1 5. 

There are a variety of ways that the user can make selections through the 
user interface 115. In some embodiments, the user utilizes a pointing device 
(e.g. mouse, track ball, joy stick) to make a selection. In other embodiments, the 
10 user utilizes a keyboard device to make a selection. In yet other embodiments, 
the user utilizes a microphone and a voice recognition system to make a 
selection. 

In Block 520, the user's activity detected in 510 is compared with at least 
one user action identification profile accessed, e.g., via database module 340. 

15 In Block 530, the user's detected activity is scored based on a comparison 

between the user's detected activity and a user action identification profile. In 
one embodiment, if the user's detected activity matches a portion of a user action 
identification profile, then this matching user action identification profile is 
attributed with an incremental, positive comparison score. In one example, with 

20 each instance the user's activity matches for a particular user action identification 
profile, the comparison score associated with the particular user action 
identification profile gains an additional, incremental score. 
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In Block 540, if there is not a sufficient amount of a user's detected activity 
data for a match, then additional user activity is detected in the Block 510. If 
there is a sufficient amount of detected activity data for a match, then a user's 
identity is determined in the Block 550. 
5 In some embodiments, there are multiple ways to determine the 

sufficiency of the detected activity data to determine the user's identity such as 
having the comparison score reach the predetermined threshold score and 
finding a best match with user action identification profile after the predetermined 
length of time. 

10 In one embodiment, a predetermined threshold score is utilized to 

determine the sufficiency of the detected activity data. In one instance, once the 
comparison score corresponding with a user action identification profile reaches 
or exceeds the predetermined threshold score, then there is sufficient detected 
activity data. 

15 In one embodiment, the predetermined threshold score is established 

based on the number of user action identification profiles within the database 
module 340. For example, if there are a large number of user action 
identification profiles to select from within the database module 340, then the 
predetermined threshold score is set to a higher value to ensure a reasonable 

20 expectation of success in correctly determining the user's identity. 

In another embodiment, the predetermined threshold score is established 
based on the importance of correctly determining the user's identity. For 
example, a higher value is assigned to the predetermined threshold score when 
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determining the user's identity is important for reasons such as security and 
privacy. 

In other embodiments, a predetermined length of time is utilized to 
determine the sufficiency of the detected user's activity data. For example, in 
5 one instance, once the predetermined length of time expires, then the detected 
user's activity data is deemed sufficient to determine the user's identity. 

In one embodiment, the predetermined length of time is established based 
on the number of user action identification profiles within the database module 
340. For example, if there are a large number of user action identification 
10 profiles to select from within the database module 340, then the predetermined 
length of time is set for a longer duration to ensure a reasonable expectation of 
success in correctly determining the user's identity. 

In another embodiment, the predetermined length of time is established 
based on the importance of correctly determining the user's identity. For 
15 example, a longer duration is assigned to the predetermined length of time when 
determining the user's identity is important for reasons such as security and 
privacy. 

In some embodiments, a predetermined threshold score is utilized to 
determine the sufficiency of the detected user's activity data. In other 
20 embodiments, a predetermined length of time is utilized to determine the 
sufficiency of the detected activity data. In yet other embodiments, any 
combination of a predetermined threshold score and a predetermined length of 
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time may be utilized to determine the sufficiency of the detected user's activity 
data. 

In Block 550, the user's identity is determined based on the comparison 
score corresponding to each of the user action identification profiles. In one 
5 instance, the user's identity corresponds with the user action identification profile 
having the highest comparison score for the user's activity data within the 
predetermined length of time. In another instance, the user's identity 
corresponds with the user action identification profile having the highest 
comparison score for the user's activity data within the predetermined length of 
10 time. 

Figure 6 is a flow diagram that illustrates how the collection of a user's 
activity data for a user action identification profile is advanced. 

In Block 610, the user's identity is authenticated. In some embodiments, 
the user's identity is authenticated based on the highest comparison score for a 
15 user action identification profile which corresponds to the identified user as 

demonstrated in the Block 550 within Figure 5. In other embodiments, the user's 
identity is independently confirmed based on a password, fingerprint, iris scan, 
personal identification number, and the like. 

In Block 620, the confirmed user's activity is detected. In one 
20 embodiment, the user's activity is detected by the detection module 320. 

In one instance, for example, the user's activity includes both the actual 
activity performed and the order in which particular activities are performed. In 
another instance, detection module 320 is configured to sense one or more times 
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associated with the user's activity on electronic device 1 1 0. For example, 
detection module 320 determines a time interval between inputs (e.g., between 
two user menu selection inputs). 

In Block 630, the user's activity data associated with the user's activity is 
5 stored. In some embodiments, the data corresponds to activity(ies) performed by 
a particular user and is associated with a corresponding user action identification 
profile. 

In one embodiment, the user's activity data is stored within the database module 
340 as a user action identification profile for the identified user. In one instance, 

10 the selection decisions performed by the identified user are stored as the user's 
activity data within the user action identification profile. For example, in one 
instance selection of the albums 475 and 465 by the identified user are stored as 
the user's activity data within the user action identification profile. In another 
instance, the selection order of the user's decisions are stored in the user action 

15 identification profile. For example, in one instance the user's selection order of 
the albums 475 and 465 is stored in the user's activity data within the user action 
identification profile. 

In Block 640, the user's activity data associated with the user action 
identification profile is organized. In some embodiments, the user's activity data 

20 is grouped according to the particular identified user. For example, activities 
performed by multiple users are grouped according to each user action 
identification profile. In another embodiment, the user's activity data is grouped 
according to the timing of when the user's activities are conducted. For example, 



activities performed by multiple users are grouped according to when these 
activities were conducted by each respective user. 
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